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Abstract. We investigate in detail the phase diagrams of the p-body ± J Ising model 
with and without random fields on random graphs with fixed connectivity. One of our 
most interesting findings is that a thermodynamic spin glass phase is present in the 
three-body purely ferromagnetic model in random fields, unlike for the canonical two- 
body interaction random-field Ising model. We also discuss the location of the phase 
boundary between the paramagnetic and spin glass phases that does not depend on the 
change of the ferromagnetic bias. This behavior is explained by a gauge transformation, 
which shows that gauge-invariant properties generically do not depend on the strength 
of the ferromagnetic bias for the ± J Ising model on regular random graphs. 
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1. Introduction 

Two typical examples of disordered system in statistical physics are the spin glass and 
the random-field Ising model. The basic model of the former is the Edwards- Anderson 
model [1] with quenched randomness in interactions. The Sherrington-Kirkpatrick 
model [2] is the infinite-range (fully-connected) version of the Edwards- Anderson model 
and is considered to constitute the mean-field paradigm of the theory of spin glasses. The 
exact solution of the Sherrington-Kirkpatrick model is now established and is known to 
possess quite unusual properties represented by the symmetry breaking in the abstract 
space of replicas [3, 4, 5, 6, 7]. The spin glass theory has also been applied to a variety 
of problem in other disciplines including information theory [6, 7]. 

The Edwards-Anderson model on the random graph is closer to real physical 
systems than the Sherrington-Kirkpatrick model because the former has a finite 
connectivity whereas the latter is fully connected although both are of mean-field 
nature. Random systems on the tree-like lattice can be analyzed by the cavity 
method [3]. Stability of the replica-symmetric (RS) state as formulated by de Almeida 
and Thouless for the Sherrington-Kirkpatrick model [8] can also be analyzed on the 
Bcthc lattice [9, 10, 11], and the effects of replica-symmetry breaking (RSB) have been 
studied by a generalization of the cavity method [12]. The problem of spin glasses on the 
finitely-connected sparse graphs in general has also been a useful platform to formulate 
random optimization problems [7]. 

As for the random- field Ising model (RFIM), the infinite-range version has been 
solved by Aharony [13]. This model has ferromagnetic and paramagnetic phases but 
no spin-glass phase. The boundary between the two phases represents a second-order 
phase transition for small values of the field strength and a first-order transition for large 
values if the distribution of random fields is bimodal. The RFIM on a finite connectivity 
graph also shows a first-order phase transition for larger values of connectivity than 
three [14, 15]. For the three-dimensional RFIM the replica field theory has suggested the 
existence of a replica-symmetry-brokcn (RSB) phase (spin-glass phase) in the vicinity 
of the phase boundary [5, 16, 17, 18, 19, 20, 21, 22, 23]. However, nonexistence of the 
spin-glass phase in the RFIM with two-body interactions has been proved recently for all 
lattices and field distributions [24] , and the problem of the existence of a spin-glass phase 
in the RFIM has thus been solved negatively as long as the interactions are two-body 
and purely ferromagnetic. 

It is therefore interesting to study in more detail the interplay of randomness in 
interactions and fields on the random graph, in particular in the presence of many- 
body interactions. Our numerical results show that the phase boundary between the 
spin glass and paramagnetic phases does not change if we vary the ferromagnetic 
bias p, the probability that an interaction on a bond is ferromagnetic in the ±J 
model. This has been known for the ±J Ising model without field on the regular 
random graph as a horizontal paramagnetic-spin glass boundary on the p-T phase 
diagram. Our result generahzes this knowledge to phase diagrams on the H-T 
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plane and the p-H plane, where H is the magnitude (strength) of symmetrically 
distributed random fields. This p-independence can be understood by a simple gauge 
transformation. We also show that the RFIM has a thermodynamic spin-glass phase 
if it has three-body even purely ferromagnetic interactions. Thus the proof for the 
absence of a spin glass phase in the RFIM [24] cannot be generalized to more than 
two-body interactions. This result reinforces previous findings on the glassy behavior of 
ferromagnetic systems [25, 26, 27, 28]. 

2. Formulation 

In this section, we formulate the ± J Ising model in random fields on the regular random 
graph. We review the cavity method, which enables us to study infinite-size systems 
numerically and analytically. 

2.1. Cavity method 

We consider the ± J Ising model in random fields with p-body interactions on the random 
lattice having connectivity c (figure 1). The Hamiltonian is 

N 




(1) 



(jji,— Jp-i> 



1=1 



where ai is randomly distributed as 




h (ai + (ai + 1) 



(2) 



and Jii 
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where 1/2 < p < 1. 
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Figure 1. The local structure of the three-body {p = 3) Ising model on the tree with 
the connectivity c = 2. 
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Our definition of the regular random graph is a randomly connected graph with 
fixed connectivity c [12, 29, 30]. In the thermodynamic limit, the regular random graph 
can be identified with the Bethe lattice with proper boundary conditions, because the 
local structure is tree-like (figure 1) and the typical length of the loop on the lattice 
diverges as log N, where N is number of sites. In this situation we can apply the cavity 
method. To fix the notation as well as for completeness of presentation, we present a 
short review of the cavity method for the generalized Ising model on a locally tree-like 
lattice. 

The effective field at site i is calculated iteratively by a partial trace from c — 1 
spins connected to the current site. The independent effects of c — 1 interactions have 
been passed to the current site i in terms of the cavity field hi and cavity biases {uj}, 
the definitions of which are given by 



c-1 



p-1 



hi = + ^ X] t^^h ^ ( t^^h {i^Jiji-jp-i) n ^^^^ ii^^jk) 



c-1 

CiH -\- ^ ^ Uj ( Jij^ ■■■jp-n hjf. ) , 



k=l 



and 



p-1 



tanh ^ tanh (^Jjj^...j-p_i) JJtanh(^/ijJ , 



(4) 
(5) 

(6) 



k=l 



where j3 is the inverse temperature, j labels c — 1 interactions and k labels p — 1 spins 
per interaction on the layer previous to the current site i (figure 1). 

After very many steps of these update rules, the effective field is obtained as 



and the marginal probability that site i takes 5'i = ±1 is 



(7) 



(8) 



2 cosh ■ 

The Bethe free energy / is calculated from the sum of the site and the bond terms 
[31, 32, 33] as 

-pf = - {c-1) log [2 cosh^/i^'^)] 

(9) 



+ - log 
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If we neglect the possibility of RSB for the regular random graph, the distribution 
of the cavity field at the Zth step P' {h) is updated as [7] 
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where [■ ■ denotes the average over the random interactions Jiji-jp_i and fields cTj. 
If the distribution of the cavity field converges, the P {h) — lim;_^oo -P' {h) satisfies the 
following self-consistent equation, 

c— 1 p— 1 
J,H J=l ^==1 



P{h) 



c-1 



6{h - aiH {Jih-jp-i^hj^)) 



P(^) (h) - J 



S{h — GiH — Uj (J^ 



and the distribution of the effective field is derived from 

c 1c p—1 

iji-jp-n 

UUP(h^^)dhj,.{12) 

- J,H J=l ^==1 

Sometimes the RS solution is not correct and we need an RSB ansatz, which is 
much more complicated even for the one-step RSB (IRSB) solution. In order to draw 
phase diagrams of the present model, we use the IRSB cavity method with the Parisi 
parameter m = 1 (to be distinguished from magnetization) [34, 35]. To this end, we 
define the message ijj^' (hi) — e^^^^^ / 2 cosh. /3 hi which denotes the marginal probability 
of (Sj = ±1 in the absence of the spin of the next step. The joint probability distribution 
of messages of the RS and IRSB {m — 1) ansatz is updated as [34, 35] 



{S.J 
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E5, E{5,J 



cxp {j3Si Y.j Jih-jv-1 rife Sj^ + (5HaiS^ Y[. ^' 
The initial condition for distribution Pg^ is 

(V'SsB, V'S) = P (V'S) 5 (V'SsB - 5SIS) (14) 

In order to identify the IRSB spin glass phase boundary, we define the complexity 
function E as the difference between the free energies calculated with ■^rs and ■0irsb, 

S = -;5/rs + ^/iRSB(m=i), (15) 

where /rs is obtained from equation (9). On the other hand, /iRSB(m=i) is calculated 
from [34, 35] 
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E{5,} exp (/3 • • • + ^ Er ^5,^0 a V'Rf 

Actual calculations to identify the phase boundaries are described in the next 
subsection by using the cavity and effective field distributions. 



2.2. Numerical implementation 

The cavity method is implemented numerically in terms of the population method which 

, , s' s' 

realizes the probability distributions, P^^> (h), P (u) and {PsiO'iRSB^ i^Rs)} ^ large 

amount of representative samples. The number of variables representing the distribution 

we use is A^pop = 10^. 

There is an ambiguity in the initial condition of the RS iteration equation. As 

typical initial conditions, we have used the following two conditions for the RS cavity 

method. 

(i) Ferromagnetic: all surface spins being in the up-state, which corresponds to 

„,imt — J. . 

(ii) Free: all surface spins being indeterminate as = ±e where e ^ 0. This initial 
condition induces the paramagnetic solution of equation (5). 

These conditions possibly derive different convergent distributions. An example is a first- 
order phase transition. In this case, we should choose an appropriate initial condition for 
the iterative solution of equation (11) to find the correct solution having the lowest free 
energy among all solutions of equation (11). Then the other solutions are metastable 
states due to the nature of the first-order phase transition. 

We have performed at least 10, 000 updates of the cavity iteration until the 
distributions converge. After that, we have measured the physical values from the 
average of additional 20, 000 iterations. 

Physical values characterizing the ferromagnetic and spin-glass phases are 
numerically calculated using the population method. The disorder averaged spontaneous 
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magnetization is given by 
m — — lim 



OH, 



= I dhP^'^ {h)tSillh{Ph), 
J,H J 



(21) 



where Hq is an additional uniform external field. The staggered magnetization is also 
calculated as 

df 



m — — 



OH 



J dh (P^^^ [h) - p!'^ (/i)) tanh {(3h), (22) 



where P^^ denotes the distributions of the effective field having positive and negative 
signs of external field, respectively. The distribution of the cavity field satisfies 

p(-) {h) = Pj^) {h) + p!'^ {h) . (23) 

The onset of a spin-glass phase based on the local stability of the RS ansatz is 
signaled by the divergence of the spin-glass susceptibility defined as 
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(24) 

J,H G 

where the subscript G denotes the index from a fixed site of the graph to site G along 
the unique path. The divergence of xsg is caused when 

2 / n \ 2" 



lim (c — 1 
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(25) 
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The essential part of the divergence is [(9mo/9mg)^] j^. This is implemented as an effect 
of a small perturbation to the cavity bias in numerical calculations [36, 37, 38, 24, 30] . 
The numerical evaluation of the factor duo/duo is straightforward, 

duo Uo {uq Ai^g) - Uq (ug) 



du 



G 



Aug 



(26) 



where Aug is a small perturbation which we set to 10~^. We prepare two replicas 
of identical convergent population of {ui} and introduce a uniform perturbation 
into only one of the two replicas. Then we observe the square average of the 
variation, (1/A^pop) ^f^^'^{ui{uG + AuG) —Ui{uG)Y, after 10, 000 updates of the iteration 
equation (6) with the same bond and site randomness for the two replicas. 

The IRSB spin-glass phase is signaled by the complexity function defined in 
equation (15). With temperature decreasing, the complexity function E would jump 
from zero to a positive value at the dynamical IRSB transition temperature and become 
zero at the equihbrium IRSB transition temperature [34, 35]. We have calculated this 
value for three-body (p = 3) systems as shown in the next section. 



3. Phcise diagrams 



The results of the numerical implementation described in the previous section are shown 
here in terms of the phase diagrams under various conditions. 
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Figure 2. (Colour online) Staggered magnetization for the random field Ising model 
(p = 1) on the regular random graph with two-body interactions {p — 2) and 
connectivity c = 3 (left) and c = 4 (right) . Solid and dashed lines denote the numerical 
results with ferromagnetically fixed and free initial conditions, respectively. The system 
has singularities at H = {c — 2) + 2/M {M = 1, 2, • • •) at zero temperature, and the 
spinodal point of the ferromagnetic phase is given by Hp^ — c — 2. 

3.1. The random-field Ising model with two-body purely ferromagnetic interactions 

Firstly we show our investigation for the purely ferromagnetic random-field Ising model 
(p = 1) with two-body interactions {p = 2) and connectivities c = 3 and 4. The absence 
of a spin-glass phase has been proved for this case (p = 1, p = 2) irrespective of the 
connectivity [24]. 

At zero temperature, the spinodal point of the ferromagnetic phase (i.e. the 
largest H admitting a ferromagnetic fixed point) has been solved as Hp^ = 
limM^>oo ((c — 2) -|- 2/M) = c — 2, where M is interpreted as the number of spins 
in ferromagnetic clusters at zero temperature [14]. A ferromagnetic phase transition 
is observed when the size of the cluster M is infinity, but also there are Griffiths 
singularities aX H = (c — 2) + 2/M for M = 1, 2, ■ ■ ■ only at zero temperature. For 
finite temperatures the phase boundary has been evaluated approximately by several 
techniques [14, 15, 39, 40, 41, 42, 43, 24], and with the cavity method in [24]. Here we 
give more details for finite-temperature case. 

When p = 2 and c < 3, the transition is second order. Otherwise it is first order 
where hysteresis is observed in the magnetization [14, 15, 44]. Figure 2 shows the 
staggered magnetization for p = 2, c = 3 and 4 from T = to 0.5. Only at zero 
temperature, the staggered magnetization jumps at H = (c — 2) + 2/M for both cases 
of c = 3 and 4 but does not for finite temperature except at transition points. 

For c = 4, the convergent distribution P^^^ [h] has two solutions. The magnetization 
exhibits different results depending on the initial condition for equation (11) at low 
temperature, while there is a unique solution for c = 3. Thus, for the systems with 
c = 4, the transition is first order at low temperature. The higher transition temperature 
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Figure 3. (Colour online) Phase diagrams of the random field Ising model with p = 2 
on the regular random graph with c = 3 (left) and c — 4 (right). The symbols stand for 
the paramagnetic (P) and ferromagnetic (F) phases, and TCP is for the tricritical point. 
Zero field transition points are given by T^^ (H = 0) ^ 1/ tanh"^ (1/ (c - 1)) ~ 1-820 
(c = 3) and 2.885 (c = 4) for the ferromagnetic phase. In the right panel, spinodal 
lines are drawn dashed for paramagnetic (blue) and ferromagnetic (black) phases. 

represents the limit of stability of the ferromagnetic solution and the lower is for the 
paramagnetic solution. The two transition points may be identified by changing the 
field H, i.e. increasing or decreasing H as indicated in arrows in figure 2. 

The equilibrium phase boundary lies between these two critical-field values, which 
correspond to the metastability limits of respective phases. As shown on the right panel 
of figure 3, these two metastability limits merge at a tricritical point, and a second-order 
phase transition takes over beyond the tricritical point for lower H and higher T. The 
equilibrium phase boundary is calculated as the points where free energies for the two 
solutions have the same value by using equation (9). 

3.2. The random-field ±J Ising model with two-body interactions 

No spin-glass phase is observed under the two-body pure-ferromagnetic condition as 
shown in the previous subsection but it readily appears by the introduction of a small 
amount of bond randomness. In fact, the zero-temperature para-ferro transition point 
of the pure ferromagnetic shown in figure 3, turns out to be a multicritical 

point where paramagnetic, ferromagnetic and spin-glass phases coexist as will be shown 
below. 

Figure 4 shows the zero temperature (T = 0) phase diagram of the ± J Ising model 
in random fields with p = 2 and c = 3 (left) and c = 4 (center and right). We see that 
the transition point at p = 1 and T = behaves as a multicritical point. This means 
that the introduction of any small amount of bond randomness produces a spin-glass 
phase as an equilibrium state (c = 3) and a metastable state (c = 4). The spin-glass 
has ferromagnetically ordered state in the mixed phase. 
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Figure 4. (Colour online) Zero temperature (T — 0) phase diagram of the ± J Ising 
model in random fields with two-body interactions with connectivity c — 3 (left panel) 
and c = 4 (center and right two panels). The red lines denote the boundaries of the 
spin glass phase. The symbols stand for the spin glass (SG) and mixed (M) phases and 
the tricritical (TCP) and multicritical (MCP) points. The mixed phase is the region 
surrounded by the spin glass and ferromagnetic phase boundaries. For c — S the zero 
field critical probability is analytically known: one has pf^ = 11/12 for the spin-glass 
phase [45, 46] while p^(RS) = 7/8 at the RS level [45, 46] and (IRSB) « 0.857 at the 
IRSB level. In the limit of _ff — and T — )■ 0, our value of is a bit lower than the 
RS one of references [45, 46] since we work with real cavity fields whereas references 
[45, 46] have integer ones. It is still, however, larger than the IRSB value which is 
usually very close from the exact value. For c = 4 (center and right panels) the phase 
diagram has a phase coexistence region. The right panel shows a blow up of the center 
panel in the vicinity oi p = 1 with the ferromagnetically-fixed initial condition (i) in 
Section 2.2 (upper) and the free initial condition (ii) (lower). The equilibrium phase 
boundaries are shown by solid lines and spinodal lines are by dashed lines. The spin 
glass-paramagnetic boundaries dX H = 1.0 (c — 3) and H = 1.5275(5) (c — 4) show no 
dependence on p. 



For c > 3, a first-order ferromagnetic transition lias been found at p = 1. The 
first-order transition line extends from p = 1 to some ptcp < 1? and a locally stable 
ferromagnetic solution exists in this area. The phase diagram (right panel of figure 4) 
is thus more complex than the case c = 3 due to the nature of the first-order phase 
transition. 

The phase boundary between the spin glass and paramagnetic phases is independent 
of the ferromagnetic bias p. This behaviour is clearly shown in the finite temperature 
phase diagram: Figure 5 depicts phase diagrams for p < p^^^ = [2 + \/2) /4(= 0.8536) 
(^^MCP j^g^g jg defined such that at this density Tf = Tf^) and p = 0.90, pf^{= 11/12 = 
0.9167) and 0.93 with c = 3. The ferromagnetic phase vanishes for p < p^^^, and 
p^*^ = 11/12 is defined as the limit below which (p < p^^) the H = system has a finite 
temperature spin glass phase. For p < p^^^, the spin-glass phase boundary shows no 
dependence on p down to 1/2. On the other hand, the ferromagnetic phase exists for 
p > p^*-'^, and phase boundaries of ferromagnetic and mixed phases depend on p, which 
shrinks with decreasing p. 
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Figure 5. (Colour online) Phase diagrams of the two-body ± J Ising model in random 
fields with c = 3. The ferromagnetic phase shrinks as p is decreased and the spin-glass 
phase appears from behind the ferromagnetic phase. The dashed line stands for the 
spin-glass phase boundary for p — 0.5 drawn for the guide of the eyes. It does not 
represent a real phase boundary. 



3.3. Three-body interactions 

The independence of p of the spin glass-paramagnetic boundary appears also in 
systems with three-body interactions in random fields with and without randomness 
in interactions. 

The left panel of figure 6 is the phase diagram obtained from the IRSB cavity 
method for p = 1. The dashed black line denotes the spinodal of ferromagnetic phase. 
The red dashed line is the dynamical spin glass temperature, and the solid red line is 
the static (Kauzmann) spin glass temperature. The solid black line is the equilibrium 
phase boundary obtained from the comparison of ferromagnetic and paramagnetic free 
energies. Note that the lower part of the ferromagnetic-spin glass phase boundary is 
derived from a comparison between free energies of the ferromagnetic and spin-glass 
solutions based on the RS ansatz. Thus this phase boundary is inaccurate. However, 
the spin glass phase surely exists adjacent to the ferromagnetic phase in the high-if. 
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Figure 6. (Colour online) Phase diagrams for the three-body random-field Ising model 
(c = 4) for p = 1 (left) and p = 1/2 (right). The black dashed line denotes the spinodal 
line of the ferromagnetic phase. Solid black line is the equilibrium phase boundary of 
the ferromagnet. The red dashed line is the dynamical glass transition and the solid 
red line the static (Kauzmann) glass transition. The spin-glass phase exists for any p 
unlike the two-body interacting system (figure 3), but there is no mixed phase. The 
spin-glass phase boundaries in two panels coincide. The phase diagram shown in the 
right panel does not depend on the ferromagnetic bias p as long as we consider only 
spin glass and paramagnetic solutions. 

low-T region. Therefore the proof of the absence of a spin glass phase in the random-field 
Ising model does not apply beyond its limit of two-body interactions [24]. 

The right panel of figure 6 is the phase diagram for p = 1/2. The spin glass 
phase boundaries (red, solid and dashed lines) in the left and right panels are identical 
to each other. In addition, the phase diagram in the right panel is obtained also for 
arbitrary p for magnetization fixed to zero. The p dependence does not appear outside 
the ferromagnetic phase for the three-body system. It is expected that the ferromagnetic 
phase boundary again shrinks with decreasing p and the spin glass phase hidden behind 
the ferromagnetic phase gradually emerges. 

The spin glass phase for the three-body system is observed as IRSB. By analogy 
with the study for fully-connected graphs [47], the full-RSB (FRSB) spin glass phase 
may exist in the high-if region. In order to draw the boundary between IRSB and 
FRSB phases, however, we need to analyze the stability of the IRSB solution, which is 
beyond the scope of this paper. 

At zero field, we obtained dynamical and static/Kauzmann IRSB spin-glass 
transition temperature as tJ^^sb _ g. 7526(1) and T^^^^^ = 0.6547(3), respectively, 
and the complexity function S (T = T]^^^) = 0.05415(3) by 2.0 x 10^ updates of the 
population with 10^ variables. These values agree well with those in references [28, 48]. 

3.4- The ± J Ising model without field 

Also for the system without external field (the usual ±J Ising model), we observe the 
independence of p of the phase boundary between spin glass and paramagnetic phases 
as shown in figure 7 (see also figure 1 in [49]). The spin glass-para phase boundary 
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Figure 7. (Colour online) Phase diagrams of the ±J model without external field 
for p ~ 2, c — 3 (left) and p ^ 3, c — 4 (right). The solid and dashed lines show the 
static/Kauzmann and dynamical transition points, respectively, and the chained black 
lines denote the Nishimori line defined as e^^ = p/ (1 — p) [50]. In the right panel, the 
phase boundary between ferromagnetic and spin glass phases below the equilibrium 
multicritical point is obtained from the comparison between the the ferromagnetic 
and RS paramagnetic solutions. This boundary is thus inaccurate and at the IRSB 
level these are instead almost straight lines below the multicritical point in both cases 
[46, 49]. 

is horizontal for both static and dynamical critical temperature lines. The transition 
points for p = 2 and c = 3, the case of the left panel, does not depend on p and are 
analytically given by Tp (H = 0) = 1/ tanh^^ (1/ (c — 1)) for the ferromagnetic phase 
and TsG {H = 0) = 1/ tanh^^ (l/Vc — l) for the spin-glass phase [9, 51, 52, 53]. The 
spin glass phase appears even in the pure ferromagnetic system. This feature is seen 
also in figure 6. 

Note that the phase boundary between ferromagnetic and spin glass phases below 
the multicritical point in the right panel is not exact, because it is obtained from the 
free energies based on the RS ansatz, i.e. comparison between the ferromagnetic and 
paramagnetic solutions. One needs to investigate the free energy in the IRSB spin 
glass phase at finite temperature in order to find the correct phase boundary, as e.g. in 
[46, 49]. 

4. Distribution of zeros on the complex-field plane 

Distribution of partition function zeros is one of the unique viewpoints of the phase 
diagram [54, 55, 56], and it can also be understood as the generalized (complex valued) 
phase diagram. In this section, we confirm the p-independence of system properties 
outside the ferromagnetic phase, as found in the previous section, on the complex-field 
plane. The distribution of zeros clearly shows the difference and similarity between the 
system for p = 1 and 0.5. All results of distributions of zeros have been obtained based 
on the RS ansatz. 
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In reference [30], the authors have found the relationship between the distribution 
of complex cavity field P^|g {h) and the two-dimensional (real) density of zeros g2 (H) 
as 



where H — 2^H, and h and ^ are complex values. Also, the one-dimensional density of 
zeros in general is calculated as [55], 



where e is an infinitesimally small complex number which is normal to the curve of 
the one-dimensional density of zeros and m = —df/dH is also of complex value. If 
the external field is uniform, rh is the usual magnetization whereas rh is defined as the 
staggered magnetization shown in equation (22) for systems with random fields. These 
relations enable us to see the distribution of zeros in the infinite system size. 

Transition points are identified as the locations where zeros touch the real axis on 
the complex-parameter plane, because the free energy has a singularity at the location 
of partition function zeros. The one-dimensional distribution of zeros crosses the real 
axis at the ferromagnetic transition point whereas the spin glass phase is characterized 
that the continuous (two-dimensional) distribution of singularities touches the axes of 
real field and temperature [30]. 

In figure 8, we show the distribution of zeros on the complex-field plane for the 
two-body ±J Ising model with random fields for p = 1 (left panel) and p = 0.5 (right 
panel) with connectivity c = 3atT = 0.5. For numerical evaluations of the distribution 
of zeros, the complex- plane has been split into cells by dividing the real axis from 

= to 12 with an increment 0.25 and the imaginary axis from — 0.02 to tt/2 
with an increment of 0.02. The distribution of zeros has a symmetry with respect to the 
real and imaginary axes, and therefore only the first quadrant is shown. Both gi and g2 
are plotted in the same figure and coloured in a logarithmic scale; a black dot shows a 
very high density. 

In the left panel of figure 8, the ferromagnetic phase (defined as the region to the 
left of the one-dimensional distribution) is bounded by the thick black line representing 
gi > where jumps. It crosses the real axis at the (real) ferromagnetic transition 
point. The region to the left side of gi may thus be characterized as the ferromagnetic 
phase. Compared to the right panel, the distribution of zeros outside the ferromagnetic 
phase is the same as the one for p = 0.5. Therefore the distribution of zeros outside the 
ferromagnetic phase does not depend on p while the phase boundary of the ferromagnetic 
phase does. The two-dimensional distribution of zeros g2 to the left side of gi barely 
exists in the vicinity of gi. It would expand and lead to the mixed phase with decreasing 
p as shown in figure 5. 

For the three-body system, on the other hand, there exists the spin glass phase 
for the random-field Ising model even when p = 1. The left panel of figure 9 shows 
the distribution of zeros for the system of p = 1 with the ferromagnetic solution of 



g2(H)^P^^^(h^m/2P), 



(27) 




1 



(28) 
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Figure 8. (Colour online) The distributions of partition function zeros on the complex 
2/3 iJ plane for the two-body ± J Ising model with random fields for p = 1 (left) and 
p — 0.5 (right) at T = 0.5. The one-dimensional distribution of zeros (drawn in a 
thick line) runs vertically in the left panel. The distribution to the right of this one- 
dimensional distribution is the same as the distribution on the right panel in the same 
region, showing its independence of p. 




Figure 9. (Colour online) The distributions of partition function zeros on the complex 
2/3iJ plane for p = 1 (left) and p = 0.5 (right) for three-body interactions with the 
ferromagnetically- fixed initial condition at T — 0.5. There is the spin glass phase 
even for the pure ferromagnetic system, which is shown as the continuous singularity 
of the system in the left panel. The right panel can be obtained also from the 
pure ferromagnetic random-field Ising model with the non-magnetized solution of 
equation (11). 
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equation (11). The spin glass phase is characterized by the continuous distribution of 
singularities, see the region to the right side of gi along the real axis in the left panel 
of figure 9. Comparison to the distribution for the case of p = 0.5 (right) suggests the 
independence of p outside the ferromagnetic phase for the three-body system as well. 
Note that the distribution of zeros shown in the right panel of figure 9 is also obtained 
from the case of p = 1 with the non- magnetized solution of equation (11). Due to the 
absence of spontaneous magnetization originated from a first-order phase transition, 
the system property is completely independence of p for some solutions. This is an 
important difference between the two- and three-body systems. Incidentally, there is 
no two-dimensional zeros in the ferromagnetic phase of the left panel of figure 9, which 
is consistent with the absence of a mixed phase in the three-body random field Ising 
model (the left panel of figure 6). 

5. Gauge transformation 

In previous sections, we have investigated the phase diagrams of the two- and three-body 
±J Ising model with and without random fields. Our numerical results suggest that 
many of the important properties of the system do not depend on the ferromagnetic 
bias p. This behavior can be explained using a gauge transformation, and this appeared 
for various special cases of models on random graphs in the literature, see e.g. [57, 59]. 
Since we do not know of an article with a detailed and general explanation of the 
associated reasoning, we provide one in this section. We split the argument in two 
parts. Firstly we show the exact p-independence for trees (i.e. cycle-free graphs) and 
then for the thermodynamic limit for random graphs (i.e. locally tree-like graphs). 
Finally we discuss limitations of this p-independence. 

We recall that, on a cycle-free graph with free boundary conditions, the 
thermodynamics properties of the ±J model with symmetric distribution of random 
fields do not depend on the ferromagnetic bias p. To show this, consider a realization 
of disorder with p, and another realization with p = 1 (the pure ferromagnet) and the 
following gauge transformation 

Si ^ TiSi (29) 

'^ih—jp-i ~^ '^iji—jp-i'^i'^ji ' ' ''^jp-l-i (30) 

where Tj = ±1. As the graph is cycle-free, choose a node at random, call it a root, then 
proceed from the root to the leaves with the following transformation. Start with Ti = 1 
for all i. Consider all interactions dcsccndcnt from the root for which J = — 1. For each 
of those, choose one descendant node j (arbitrarily), set Tj = —1 and recalculate all the 
J's around node j. Now consider the second generation and again for all interactions 
with J = — 1 set Tj = — 1 for one of the descendants j. Continue this iteratively until 
the leaves are reached. This transformation is uncorrelated with the way the external 
random field was chosen. Hence any system (of any size) with symmetric distribution 
of the random field and free boundary conditions can be directly mapped to the purely 
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ferromagnetic case. 

The above mapping was possible for tree graphs with free boundary conditions 
because those do not contain any frustration. It is well known that the ±J models on 
lattices with loops and with frustration cannot be exactly mapped to the ferromagnetic 
(unfrustrated) case. This is simply because the above gauge transformation conserves 
the frustration. The ±J model without frustration is called the Mattis model [60], 
and it is well known that this one is equivalent to the ferromagnetic Ising model, which 
generalizes to the Mattis model in symmetric random fields. For models with frustration 
on random graphs, the reason for p-independence is more involved. 

Consider now a random field ±J model with ferromagnetic bias p — 1/2. The 
iteration equation for the cavity bias for this model is 

Puj^i = tanh"^ ^tanh {PJij^-jp_i) J^tanh ui^j^ + (3aj^H^^ .(31) 

Now, if we consider the gauge transformation Jijj^...jp_i = Jiji-jp-iTiTj-^ ■ ■ ■Tjp-i where J 
has an arbitrary ferromagnetic bias p and symmetric distribution P^- (r), equation (31) 
changes to 

Pnuj^i = tanh"^ l^tanh (^0ij,...jp_,^ (^^J^Vi^jk+^^jk^JkH^^ -(32) 

Notice that the symmetric distribution of r guarantees the symmetric distribution of 
Jih-jp-i ~ •^jji-'-jp-i'^j'^ji ■ ■ ■ 'Op-i- write Uj^i = TiUj^i, the above equation is 

rewritten as 

i/jj.(33) 

Since r and a are independent, the distribution P^^ija) is also symmetric. Thus, this 
iteration equation (33) can be interpreted as that for a model with an arbitrary p. 
However, note that the distribution of Uj obtained through the gauge transformation 
is always symmetric, because r is symmetric and independent of u. Since Pu {u) for 
p — 1/2 is symmetric, Pu {u) — Pu {u) holds. Hence, the solution which has a symmetric 
distribution of cavity field does not depend on the ferromagnetic bias p. 

In the argument for p-independence on random graphs in the previous paragraph 
we used two assumptions: (i) the cavity method (with proper RSB scheme if needed) 
provides an exact solution for the system under consideration, (ii) the distribution of 
cavity fields is symmetric around zero. Assumption (i) limits the p-independence to the 
thermodynamic limit of models on random tree-Hke graphs. 

We have observed the symmetry of cavity fields on random regular graphs anytime 
the magnetization of the resulting solution was zero , i.e. for the paramagnet and the 
(non-mixed) spin glass phase. On the other hand, this explains why the ferromagnetic 
solution depends crucially on p. Moreover, the solution corresponding to the symmetric 
cavity fields formally continues to exist even in the ferromagnetic region. If the 



Random-field p-spin glass model on regular random graphs 



18 



ferromagnetic transition is of a second order (p = 2), this non- magnetized phase is locally 
unstable towards magnetized solutions. For a first order ferromagnetic phase transition 
(p > 2), it is locally stable and hence is a physically observable metastable phase. This 
is shown in figure 6 and the right panel of figure 9. In fact, in this case {p > 2), it is 
not easy to find the ferromagnetic phase without the use of ferromagnetically biased 
initial conditions. For instance, simulated annealing [61] does not work for the pure 
ferromagnetic three-body system without field, although the ground state is trivial. The 
three-spin ferromagnet is actually used as one of the hardest examples of optimization 
problems with a known solution [58]. 

Coming back to condition (ii) on the symmetry of the cavity fields, we want 
to stress that in general fixing the magnetization to zero does not ensure that the 
corresponding cavity field must be symmetric and p-independent. The reason is that 
the symmetric cavity field gives zero magnetization but the inverse is not always correct 
(see equation (21)). A counter-example is given by the ferromagnetic model without field 
at magnetization fixed to zero on Erdos-Renyi random graph which is not equivalent to 
the corresponding spin glass model [59]. 

Note now that for p = 1/2 the random bimodal field model is equivalent to the 
uniform field spin glass model. Hence on the T-H plane, the spin-glass phase boundary 
for the present model is the same as the de Almeida-Thouless line for the symmetric 
± J Ising model in a uniform field when we equate the strength of random field H with 
that of uniform field. Thus the spin-glass phase boundary outside the ferromagnetic 
phase lies on the de Almeida-Thouless line. This property does not depend on p, but 
the ferromagnetic phase boundary does. On the H-p and T-p planes as well, the spin- 
glass phase boundary is a horizontal line outside the ferromagnetic phase, because an 
arbitrary location on the phase diagram except for the ferromagnetic phase can be 
mapped onto the corresponding point for the symmetric ± J Ising model. 

We also note that values of all gauge-invariant quantities do not depend on p 
outside the ferromagnetic phase. For instance, the exact sohition for the internal energy 
in the paramagnetic phase of the purely ferromagnetic system can be applied to the 
whole paramagnetic phase of the ±J model. It is consistent with the fact that the 
internal energy on the Nishimori line equals to that for the pure ferromagnetic system 
without field as = — A^etanh/?, where A^^ is the number of the interactions [50]. 
Furthermore, the values of gauge-invariant non-equilibrium quantities do not depend on 
p. For instance, the auto correlation function [{Si {t — 0) Si {t — t))]j has this property. 
This property, combined with the fact that on the Nishimori line the ferromagnetic 
configuration has properties of an equilibrium configuration, was recently used in [49] to 
argue about relationship between the glassy dynamics and melting above a first order 
phase transition. 
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6. Conclusion 

We have investigated the p-body ±J Ising model with and without random fields on 
the regular random graph with fixed connectivity c. We have focused on the phase 
boundary of the spin glass phase and have revealed its essential independence of the 
ferromagnetic bias in the interactions. 

In section 3 we have numerically evaluated the phase diagrams by using the cavity 
method. Our results indicate for arbitrary p, p and c that the spin-glass phase boundary 
outside the ferromagnetic phase coincides with the boundary at p — 1/2. This property 
appears as the horizontal phase boundary of the spin-glass phase on the T-p planes. 
Actually every non- magnetized solution of the self-consistent cavity equation of the 
distribution of the cavity field is completely independent of p. We have also shown the 
distribution of zeros on the complex field plane in section 4. Based on the comparison 
between the systems for p — 1/2 and p — the distributions are equal to each other 
except in the ferromagnetic phase. In section 5 we gave a theoretical explanation for 
the independence on the ferromagnetic bias using a gauge transformation and the fact 
that the cavity solution for random graph (with proper level of RSB) is expected to be 
exact. 

A very remarkable result is the presence of a static spin glass phase in the pure 
fcrromagnct for the three-body interactions, see figure 6. The absence of such a phase 
was proved for ferromagnetic two-body interactions [24]. Here we showed that this proof 
cannot generalize to models with many-body interactions. 

7. Acknowledgements 

This work was partially supported by CREST, JST. YM is grateful for the financial 
support provided through the Japan Society for the Promotion of Science (JSPS) 
Research Fellowship for Young Scientists Program. 

References 

[1] Edwards S F and Anderson P W 1975 J. Phys. F: Met. Phys. 5 965 
[2] Sherrington D and Kirkpatrick S 1975 Phys. Rev. Lett. 35 1792-1796 

[3] Mezard M, Parisi G and Virasoro M A 1987 Spin Glass Theory and Beyond (Singapore: World 
Scientific) 

[4] Fischer K H and Hertz J A 1991 Spin Glasses (Cambridge: Cambridge University Press) 

[5] Young A P (ed) 1998 Spin Glasses and Random Fields (Singapore: World Scientific) 

[6] Nishimori H 2001 Statistical Physics of Spin Glasses and Information Processing: An Introduction 

(Oxford University Press) 
[7] Mezard M and Montanari A 2009 Information, Physics, and Computation (Oxford University 

Press) 

[8] de Almeida J R L and Thoulcss D J 1978 J. Phys. A: Math. Gen. 11 983 

[9] Thoukss D J 1986 Phys. Rev. Lett. 56 1082 1085 
[10] Rivoire O, Biroh G, Martin O C and Mezard M 2004 Eur. Phys. J. B 37 55-78 
[11] Martin O C, Mezard M and Rivoire O 2005 J. Stat. Mech. 2005 P09006 



Random-field p-spin glass model on regular random graphs 



20 



Mezard M and Parisi G 2001 Eur. Phys. J. B 20 217-233 
Aharony A 1978 Phys. Rev. B 18 3318-3327 
Bruinsma R 1984 Phys. Rev. B 30 289-299 

Wohlman O E and Domb C 1984 J. Phys. A: Math. Gen. 17 2247-2256 

dc Almeida J R L and Bruinsma R 1987 Phys. Rev. B 35 7267-7270 

Mezard M and Parisi G 1990 J. Phys. A: Math. Gen. 23 L1229 

Mezard M and Young A 1992 Europhys. Lett. 18 653 

Mezard M and Monasson R 1994 Phys. Rev. B 50 7199-7202 

De Dominicis C, Orland H and Tcmcsvari T 1995 J. Phys. I France 5 987-1001 

Brezin E and Dominicis C 1998 Europhys. Lett. 44 13 

Brezin E and De Dominicis C 2001 Eur. Phys. J. B 19 467-471 

Pastor A A, Dobrosavljcvic V and Horbach M L 2002 Phys. Rev. B 66 014413 

Krzakala F, Ricci-Tersenghi F and Zdeborova L 2010 Phys. Rev. Lett. 104 207208 

Bouchaud J and Mezard M 1994 J. Phys. I France 4 1109-1114 

Marinari E, Parisi G and Ritort F 1994 J. Phys. A: Math. Gen. 27 7647 

Franz S and Hertz J 1995 Phys. Rev. Lett. 74 2114 2117 

Franz S, Mezard M, Ricci-Tersenghi F, Weigt M and Zecchina R 2001 Europhys. Lett. 55 465 
Obuchi T, Kabashima Y and Nishimori H 2009 J. Phys. A: Math. Theor. 42 5004 
Matsuda Y, Miiller M, Nishimori H, Obuchi T and Scardicchio A 2010 J. Phys. A: Math. Theor. 
43 285002 

Katsura S, Inawashiro S and Fujiki S 1979 Physica A 99 193-216 

Nakanishi K 1981 Phys. Rev. B 23 3514-3522 

Bowman D R and Levin K 1982 Phys. Rev. B 25 3438-3441 

Montanari A, Ricci-Tersenghi F and Semerjian G 2008 J. Stat. Mech. 2008 P04004 

Zdeborova L 2009 Acta Physica Slovaca 59 169-303 

Pagnani A, Parisi G and Ratieville M 2003 Phys. Rev. E 68 046706 

Krzakala F 2005 Prog. Theor. Phys. Supp. 77-81 

Jorg T, Katzgraber H G and Krzakala F 2008 Phys. Rev. Lett. 100 197202 
Hartzstein C and Entin- Wohlman O 1985 Phys. Rev. B 32 491-494 
Galam S and Salinas S 1985 J. Phys. C: Solid State Phys. 18 L439 L442 

Swift M R, Maritan A, Cieplak M and Banavar J R 1994 J. Phys. A: Math. Gen. 27 1525-1532 
Bleher P M, Ruiz J and Zagrebnov V A 1998 J. Stat. Phys. 93 33-78 
Nowotny T, Patzlaff H and Behn U 2001 Phys. Rev. E 65 016127 
Rosinberg M L, Tarjus G and Pcrcz-Reche F J 2009 J. Stat. Mech. P03003 
Kwon C and Thouless D J 1988 Phys. Rev. B 37 7649-7654 
Castellani T, Krzakala F and Ricci-Tersenghi F 2005 Eur. Phys. J. B 47 99-108 
Gillin P, Nishimori H and Sherrington D 2001 Journal of Physics A: Mathematical and General 
34 2949 

Montanari A and Ricci-Tersenghi F 2004 Phys. Rev. B 70 134406 
Krzakala F and Zdeborova L 2010 J. Chem. Phys. 134 034513 
Nishimori H 1981 Prog. Theor. Phys. 66 1169 1181 

Carlson J M, Chayes J T, Chayes L, Sethna J and Thouless D J 1990 J. Stat. Phys. 61 987-1067 
Carlson J M, Chayes J T, Sethna J P and Thouless D J 1990 J. Stat. Phys. 61 1069-1084 
Kabashima Y 2003 J. Phys. Soc. .Jpn. 72 1645-1649 
Yang C N and Lee T D 1952 Phys. Rev. 87 404-409 
Lee T D and Yang C N 1952 Phys. Rev. 87 410-419 

Nishimori H and Ortiz G 2011 Elements of Phase Transitions and Critical Phenomena (Oxford 

University Press) 
Krzakala F and Zdeborova L 2008 Europhys. Lett. 81 57005 

Haanpaa H, Jarvisalo M, Kaski P and Niemela I SAT Benchmarks based on 3-Regular Graphs, 
SAT Competition 2005 benchmark description. 



Random-field p-spin glass model on regular random graphs 



[59] Zdeborova L and Bocttchcr S 2010 J. Stat. Mech. 2010 P02020 

[60] Mattis D C 1976 Physics Letters A 56 421-422 

[61] Kirkpatrick S, Gelatt Jr C and Vecchi M 1983 Science 220 671 



